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Introduction 


> The SAGE III on ISS Project uses schedule risk 
analysis products to support informed decision 
making 

> Today’s Presentation Focus: 

• Inputs used to capture a complete project risk profile 

• Implementation of active schedule management 

• Method of monitoring project schedule reserve, and 
communication of project progress to stakeholders 





SAGE III on ISS Project Overview 




> Space Flight Project managed and led by NASA 
Langley Research Center 


> Partnered with the ISS Program for an instrument 
pointing system developed under the European 
Space Agency by Thales Alenia Space Italia 


> Planned for launch on SpaceX to the ISS in 2016 



SAGE III on ISS Mission 


> Third generation in a family of instruments 

> Study aerosols, ozone and other trace gases in 
Earth’s upper atmosphere 

> Supports NASA Strategic Goals 

• Extend and sustain human activities across the solar system 

• Expand scientific understanding of the Earth and the universe in which 



SAGE III on ISS Flight Hardware 



> SAGE III on ISS consists of two payloads 
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Schedule Risk Analysis Process 



Project Continuous Risk 
Management Process 



Standing Review Board Activities 


Perform Independent 
Evaluation and 
Re-assessment of Project 
Discrete Risks 


Develop Recommendations 
as part of Project Review or 
KDP Evaluation 


Deliver Project 
Risk Inputs & Analysis 
Results to Standing 
Review Board 


Deliver SRB 
Risk Inputs 
to Project 
Risk Manager 


Project 
Risk List 


Generic 
Risk List 



Project Activities 


Finalize 
Risk Inputs 
for Analysis 


PROJECT ANALYSIS 


Develop 

Schedule & Risk 
Model and Run 
Project Analysis 


Integrated 

Master 

Schedule 

t 

Task 

Duration 

Uncertainty 


FH 

7 


Perform 
Schedule Audit, 
Prepare IMS for 
Analysis 
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Continuous Risk Management 
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> Implemented at Top Project and subsystem levels 

> Subsystem leads and subject matter experts are the 
primary source of risk identification and analysis inputs 

> The RMB oversees the CRM process, makes decisions 
and allocates resources for risk management activities 




Project Analysis Tools 




> Integrated Master Schedule: Microsoft 

> Project Risk Register: Microsoft Excel 

> Analysis Software: Palisade @Risk 


Project 
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Risk Model 



> Methodology 

• Monte Carlo simulations of project schedule 

• Estimates were provided by project SME’s as part of 
developing the Project Management Baseline and 
Continuous Risk Management process 


> Project risk model included 


Task Duration Uncertainty 
Discrete Risks 

■ Top Project Risks 

■ Subsystem Risks 

Generic Risks 



■ Additional discrete risks inherent in the activities being performed 
that were not typically captured in the project risk register 
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Task Uncertainty 

> Accounts for uncertainty in task duration 
estimates 

• Estimate the minimum, most likely, and maximum duration 
estimates 
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Discrete Risks 


> Account for potential for impacts to the project 
schedule 

• Estimate the probability of a risk event occurrence 

• Estimate the minimum, most likely, and maximum schedule 
impact of the risk 

> Use of distributions 

• Triangular 

• PERT 





DISCRETE RISK 


DISCRETE RISK 
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Generic Risks 


> Project identified Generic Risks, or risks common 
to the development of any spaceflight project 

• Generic risks were not initially captured as part of the CRM 
process 

> Sample Generic Risks 

• Test Anomalies • Center Closures (Wx) 

• Facility Down-time/Availability • GSE Development 

> Inclusion of generic risks was necessary for more 
realistic model results 

> Other areas for future consideration 

• Procurement Delays • Workmanship issues 

• Logistics Coordination • Additional Software Builds 
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Cumulative Probability 



Progressing Towards KDP-D 


tii 
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Model Results & Implications 

> Indicated a need for significantly more schedule 
reserve than available at the time 

• Later than planned subsystem deliveries 

• Fixed launch date 

> Based on model results, the project took action 
to increase schedule reserve 

• Update Project plan to utilize two shifts Monday through 
Friday and single shift on Saturdays 

> Required active schedule management approach 
to meet delivery commitments 
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Active Schedule Management 


> Schedule Mitigation 

• Added an overlapping shift team for more bench strength 

• Added additional workforce and support personnel 

> Schedule Contingency 

• Coordinated authorization of work during Center closures 

• Identified compressible or descopable tasks which could buy back 
schedule reserve 

> Schedule Recovery 

• Worked additional unplanned shifts to recover schedule 

• Re-plan near term schedule tasks to maintain effective progress when 
issues arise 

> Schedule Monitoring 

• Actively monitored schedule reserve available against schedule reserve 
needed 
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Schedule Monitoring 

> Project reserve posture exceeded Center 
guidance (2 months/year during AI&T) 

• Linear reserve burn down was not appropriate because of 
high risk tests late in the schedule 

> Project Solution 

• Develop a methodology to understand the amount of 
reserve required at each major integration and test activity 

• Inform decisions regarding use of schedule reserve 

Linear Reserve Burn-down 




Reserve posture 
insufficient for 
high risk test late 
in project schedule 


Risk Informed Reserve Burn 

Down 
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Risk Informed Reserve Burn 
Down Methodology 

> Sum the mean observed impact of all risks 
adjusting for parallel risk impacts 

> Determine the scale factor of the mean observed 
impact to the reserve required at 70% 

> Scale mean observed impacts at each major 
integration activity by the 70% scale factor to 
determine the estimated reserve required for 
each activity 



♦ RESERVE REQUIRED AT 70% 

Reserve 

Reduction at 

^ / Project risk 

areas such as 

environmental 
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Benefits 


> Provides an estimate of reserve to be maintained 
as the project executed integration and testing 
activities 

> Informs decisions 

• Adding shifts or adjust staffing plans 

• Descope or compress downward tasks 

• Considered as part of risk trade for tactical decisions 

• Capitalize on opportunities 

> Serves as a management baseline to assess 
progress 

> Excellent communication tool for project 
stakeholders 




21 


Challenges 

> Scaling reserve requirements to 70% level was 
particularly challenging when iterating analysis 
over time 

• Reserve does not scale consistently from one analysis to 
the next on a progressing schedule with multiple paths 

• Risks not closed as planned needed to be carried forward 
causing downward reserve requirements to be adjusted 

> Initial rollout - new view of reserve burn down for 
project stakeholders 

• Stakeholder reception has been positive 
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Lessons Learned 


> Discrete risks managed as part of the CRM 
process did not provide a complete story for 
potential project schedule risk 

> Risk informed reserve 
Burn down was a good 
management tool to aid 
in decision making 

> Center guidelines for 
schedule reserve may not 
adequately support project 
needs 



PROJECT RISK 
PROFILE 


Next Steps 

> Refine schedule reserve burn down methodology 

> Document execution of significant common 
Flight Project tasks such as environmental tests 

• Scope of task 

• Planned vs. actual task duration (and reason for variances) 

> Document issues experienced resulting in 
schedule reserve use or other schedule impacts 

• Aid future project planning and risk management 

• Improve future risk models 

> Potential area for CADRe or other systematic data 
capture 
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